Online robot guidance and navigation in non-stationary environment with hybrid Hierarchical Reinforcement Learning

نویسندگان

چکیده

Hierarchical Reinforcement Learning (HRL) provides an option to solve complex guidance and navigation problems with high-dimensional spaces, multiple objectives, a large number of states actions. The current HRL methods often use the same or similar reinforcement learning within one application so that objectives can be easily combined. Since there is not single method benefit all targets, hybrid (hHRL) was proposed various optimize different types information in application. previous hHRL method, however, requires manual task-specific designs, which involves engineers’ preferences may impede its transfer ability. This paper, therefore, proposes systematic online under framework hHRL, generalizes training samples function approximator, decomposes state space automatically, thus does require designs. simulation results indicate superior decomposition, terms convergence rate learnt policy. It also shown this generally applicable non-stationary environments changing over episodes time without loss efficiency even noisy information.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Hierarchical Reinforcement Learning for Robot Navigation

For complex tasks, such as manipulation and robot navigation, reinforcement learning (RL) is well-known to be difficult due to the curse of dimensionality. To overcome this complexity and making RL feasible, hierarchical RL (HRL) has been suggested. The basic idea of HRL is to divide the original task into elementary subtasks, which can be learned using RL. In this paper, we propose a HRL archi...

متن کامل

Adaptive robot learning in a non-stationary environment

Adaptive control is challenging in real-world applications such as robotics. Learning has to be rapid enough to be performed in real time and to avoid damage to the robot. Models using linear function approximation are interesting in such tasks because they offer rapid learning and have small memory and processing requirements. This makes them suitable as adaptive controllers in nonstationary e...

متن کامل

Hierarchical Reinforcement Learning in Robot Control

The use of reinforcement learning in robotics suffers greatly from the curse of dimensionality, stemming from the necessity of a high DOF in a robot to solve even the simplest tasks. This paper gives an overview over several attempts to decrease this problem using a hierarchical structure of reinforcement learning, an evaluation of the problems that arise with such approaches and possible solut...

متن کامل

Reinforcement Learning in Nonstationary Environment Navigation Tasks

The field of reinforcement learning (RL) has achieved great strides in learning control knowledge from closed-loop interaction with environments. “Classical” RL, based on atomic state space representations, suffers from an inability to adapt to nonstationarities in the target Markov decision process (i.e., environment). Relational RL is widely seen as being a potential solution to this shortcom...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Engineering Applications of Artificial Intelligence

سال: 2022

ISSN: ['1873-6769', '0952-1976']

DOI: https://doi.org/10.1016/j.engappai.2022.105152